Reduction principles for quantile and 
Bahadur- Kief er processes of long-range dependent 

linear sequences 

Miklos Csorgo* Rafal Kulikt 

February 8, 2008 



Title of the document: Reduction principles LRD 
The final version (before editorial proofs) accepted to Probability Theory and 
Related Fields on 15 October 2007. 

Abstract 

In this paper we consider quantile and Bahadur-Kiefer processes for 
long range dependent linear sequences. These processes, unlike in pre- 
vious studies, are considered on the whole interval (0, 1). As it is well- 
known, quantile processes can have very erratic behavior on the tails. 
We overcome this problem by considering these processes with appro- 
priate weight functions. In this way we conclude strong approxima- 
tions that yield some remarkable phenomena that are not shared with 
i.i.d. sequences, including weak convergence of the Bahadur-Kiefer 
processes, a different pointwise behavior of the general and uniform 
Bahadur-Kiefer processes, and a somewhat "strange" behavior of the 
general quantile process. 

Keywords: long range dependence, linear processes, Bahadur-Kiefer pro- 
cess, quantile processes, strong approximation 
Short title: Quantiles and LRD 



*School of Mathematics and Statistics, Carleton University, 1125 Colonel By Drive, 
Ottawa, Ontario, KIS 5B6 Canada, email: mcsorgo@math. carleton. ca 

^School of Mathematics and Statistics, University of Sydney, NSW 2006, Australia, 
email: rkuli@maths.usyd.edu.au and Mathematical Institute, Wroclaw University, PI. 
Grunwaldzki 2/4, 50-384 Wroclaw, Poland. 

Research supported in part by NSERC Canada Discovery Grants of Miklos Csorgo, Donald 
Dawson and Barbara Szyszkowicz at Carleton University 



1 



1 Introduction 



Let {ei,i > 1} be a centered sequence of i.i.d. random variables. Consider 
the class of stationary linear processes 

oo 

Xi = Y^ Ckei-k, i > 1- (1) 
fc=o 

We assume that the sequence c^, /c > 0, is regularly varying with index —(3, 
P G (1/2,1) (written as G RV^p). This means that ~ k~^LQ{k) as 
— > oo, where Lq is slowly varying at infinity. We shall refer to all such 
models as long range dependent (LRD) linear processes. In particular, if the 
variance exists, then the covariances pk '■= EXoX^ decay at the hyperbolic 
rate, pk = L(/c)A:-(2/3-i) =: L{k)k-^, where liuik^oc Hk) / Ll{k) = B{2j3 - 
1, 1 — /?) and B{-, •) is the beta-function. Consequently, the covariances are 
not summable (cf. |14j). 

Assume that Xi has a continuous distribution function F. For y G (0, 1) 
define Q{y) = inf{x : F{x) > y} = inf{x : F{x) = y}, the corresponding 
(continuous) quantile function. Given the ordered sample Xi^n < • • • < Xn-.n 
of Xi, . . . ,Xn, let Frt{x) = J27=i ^{Xi<x} be the empirical distribution 
function and Qn{-) be the corresponding left-continuous sample quantile 
function. Define Ui = F{Xi) and En{x) = J2i'=i ^{Ui<x}i the associated 
uniform empirical distribution. Denote by ?/„(•) the corresponding uniform 
sample quantile function. 

Our purpose in this paper is to study the asymptotic behavior of sample 
quantiles for long range dependent sequences. This will be done in the spirit 
of the Bahadur-Kiefer approach (cf. [1], [16], |17j). 

Assume that Eel < ''' be an integer and define 

n r 

i = l l<jl<---<jr S = l 

SO that Ynfl = n, and y„,i = J2i=i Xi- Up< (2/3 - 1)"\ then 

<,:=Var(y„,,)~n2-P(2/3-i)L^^(n). (2) 

Define now the general empirical, the uniform empirical, the general quantile 
and the uniform quantile processes respectively as follows: 

(3n{x) = a^jn(F„(x) - F(x)), x G R, (3) 

an(2/) = <]n(S„(y) -y), y G (0, 1), (4) 
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qn{y) = cJ-ln{Q{y) - Qn{y)), y G (0, 1), (5) 

Un{y) = o-n}My - Un{y)), yG(0, 1). (6) 

Assume for a while that Xi, i > 1 are i.i.d. We shall refer to this as to 
the i.i.d. model. Denote by a^^, q^^, itjj*^ the uniform empirical, general 
quantile, uniform quantile processes based on i.i.d. samples with the con- 
stants o-~\n in (HI), dS]), ([6]) replaced with ^/n. Fix y £ (0, 1). Let ly be a 
neighborhood of Q{y) and assume that F is twice differentiable with respect 
to Lebesgue measure with respective first and second derivatives / and /'. 
Assuming that mix£iyf{x) > and sup^g/^ \ f {x)\ < oo, Bahadur in [Ij 
obtained the following Bahadur representation of quantiles 

- f{Q{yM%) =■ (7) 

with 

I^^iy) = 0^.sXn-'/\logn)'/\log\ogn)'/^), n ^ oo, (8) 

The process y G (0, 1)} is called the Bahadur-Kiefer process. Later, 

Kiefer proved in [16] that ([8]) can be strengthened to 

K'^iy) = 0,.,in-'/\loglognf/^), (9) 

which is the optimal rate. Continuing his study, in [T7j Kiefer obtained the 
uniform version of referred to later on as the Bahadur-Kiefer represen- 
tation: 

sup o^ijj) - f{Q{yM^{y) =: (10) 

2/6[0,l] 

where 

i?? = Oa...(n-V4(iogn)V2(ioglogn)i/^), n ^ oo. (11) 
Once again, the above rate is optimal. Kiefer obtained his result assuming 
(Kl) / has finite support and sup^.gj^ I/' (2^)1 < oo, 
(K2) inf,.eR/(x) >0. 

We shall refer to (K1)-(K2) as to the Kiefer conditions. 

Further on, Csorgo and Revesz [8] obtained Kiefer's result (jlOp under 
the following, weaker conditions, which shall be referred to later on as the 
Csdrgo-Revesz conditions (cf. also pi Theorem 3.2.1]): 
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(CsRl) / exists on (a, b), where a = sup{x : F{x) = 0}, b = inf{x : F{x) = 1}, 
— cxD < a < b < oo, 



(CsR2) mf,g(,,,) fix) > 0, 



(CsR3) sup,e(a,b)i^(x)(l-i^(2;))^ = sup^e(o,i)y(l-y) < 7 with 

some 7 > 0, 

(CsR4) (i) < ^ := hniy^o fiQiv)) < oo, < B := hm^^i /(Q(y)) < oo, or 

(ii) if ^4 = (respectively B = 0) then / is nondecreasing (respectively 
nonincreasing) on an interval to the right of Q{0+) (respectively to the 
left of Q(l-)). 

In particular, they showed that, under (CsRl), (CsR2), (CsR3), as n ^ oo, 

sup l/(Q(y))g?(y)-<^^(y)l = O^.J^-'/'iogiogn). 

log log n<y<l— n ^loglogn 

(12) 

Additionally, if (CsR4) holds, then, as n — > oo, 

sup \fiQiyM%) - u^%)\ = Oa.s.(n-'/'^(n)). (13) 

S/6[0,l] 

Here, and in the sequel, £(n) is a slowly varying function at infinity, but can 
be different at each place it appears (e.g. when Csorgo-Revesz conditions 
hold, then £{n) = log log n). This, via the special case of pT]) 

sup lu^'^iy) - aiid(y)| = 0^.sXn-'/Hlogn)'/\\oglogn)'/''), 
ye[o,i] 



f'(Qiy)) 



yields the Bahadur-Kiefer representation (jlip under less restrictive condi- 
tions compared to Kiefer's assumptions. In particular, Csorgo-Revesz con- 
ditions are fulfilled if F is exponential or normal. Also, if (CsR4)(i) ob- 
tains, then i{n) in (113p is log log n. We refer to [2], [9j and [iOj for more 
discussion of these conditions. We note in passing that taking sup over 
[l/(n + l),n/{n + 1)] instead of the whole unit interval, the statement (I13p 
holds true assuming only the conditions (CsRl)-(CsR3) (cf. [U Theorem 
3.1], or [6, Theorem 6.3.1]). 

As to LRD linear processes with partial sums Yn^r above, the first result 
on sample quantiles can be found in Ho and Hsing [15], where it is shown 
under Kiefer-type conditions that, as n ^ oo, one has for all /3 G (^, 1) 

sup \Qiy) - Qn{y) - n-iy„,i| = Oa.s.(n~(^+^V„,i), (14) 
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where < yo < yi < 1 are fixed and < A < - ^) A (1 - /3). This 
means that the sample quantiles Qniu), U £ (yoi yi) can be approximated by 
the sample mean n~^Yn^i = Sr=i independently of y. This quantile 
process approximation is a consequence of their landmark result for empirical 
processes; see also [E], [22] and [23] for related studies. The best available 
result along these lines is due to Wu [25j. To state a particular version of 
his result, let be the distribution function of the centered i.i.d. sequence 
{ci, ^ > !}• Assume that for a given integer p, the derivatives Fe^\ . . . , Fe^~^^^ 
of -Fg are bounded and integrable. Note that these properties are inherited 
by the distribution F as well (cf. |15j or [25j). 

Theorem 1.1 Let p be a positive integer. Then, as n —> oo, 

p 



E sup 

where 



i=l r=l 



2 

= 0(H„ + n(logn)2), 



„ ^ r 0(n), (p+l)(2/?-l) > 1 

^" \ O(nMP+i){2,0-i)2.2(P+i)(^)), (p + l)(2/3-l)<l ■ 

Using this result, under Kiefer conditions as n — > oo, Wu [26] obtained 

sup \an{y) - f{Q{y))qn{y) - a-^,n-'Ylj' {Q{y))/2\ = Oa.s.(jn^(^)), 
y&(yo,yi) 

(15) 

where jn = n~^4~2^ if /3 > ^ and jn = n~(^^~^) if /? < As argued in 
[261 Section 7.1] this bound is sharp up to a multiplicative slowly varying 
function i{n). From (jlSh and the central limit theorem for the partial sums 
J22=i -^i ™ay also deduce under Kiefer conditions and /3 G (^) §)) that 
for the Bahadur-Kiefer process 

Rn{y) = a„(y) - f{Q{y))qn{y) (16) 

we have weak convergence a^\nRn{y)^f'{Q{y))Z^/2 in Z)([yo, yi]),Csorg6- 
Revesz conditions equipped with the sup-norm topology, where Z is a stan- 
dard normal random variable. In particular, if ei,i > 1 are i.i.d. standard 
normal random variables, then, as n — > cxd, 

a->i?„(y)^</.'(cI>-i(y))ZV2 in Z)([yo, yi]), (17) 

where (f) and $ are the standard normal density and distribution functions, 
respectively. 
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This behavior is completely different compared to the i.i.d. case, for it is 
well known that the Bahadur-Kiefer process cannot converge weakly in the 
space of cadlag functions (cf., e.g., [HI Remark 2.1]). 

However, this weak convergence phenomenon was first observed explic- 
itly by Csorgo, Szyszkowicz and Wang [TT] for long range dependent Gaus- 
sian sequences. For the sake of comparison with (jl7p . assume that ei,i > 1 
are standard normal random variables and that X^fc^i c| = 1- Then the Xj 
defined by ([T|) are standard normal. Define Yn = G{Xn), with some real- 
valued measurable function G. Let Ji{y) = E (^^{F{G{X))<y} ~ v) ^li-^) i 
where Hi is the Ith Hermite polynomial. In particular, taking G = F^^^ 
we have that Yn have the marginal distribution F. The Hermite rank is 
1 and Ji(y) = —cl){^~^{y)), and we may take Yn = Xn- Note that for 
the Hermite rank 1, via L{n) ~ B(2(5 — 1, 1 — f3)LQ{n), their scaling factor 
dl = n^-^^U{n) (cf. (1.5) of [H]) agrees (up to a constant) with cj^ 
of Note also that Ji{y)J[{y) = cf)' {^-^ {y)) . Thus, for the uniform 
Bahadur-Kiefer process 

Rn{y) = an{y) - Un{y) (18) 

we may conclude from |1H Theorem 2.3] that (see also Remark 12.221 in the 
present paper), as n — > oo, 

a-lnRn{y)^(t}'{^-\y))Z^ \n D{[yo,yi]). (19) 

Comparing (117p with (119p . we see that the weak limits in Z)[yo,yi] of the 
uniform and the general Bahadur-Kiefer processes are different. 

We note that Csorgo et al. [TT] have also established the rate for the 
deviation of Rn{y) from Rn{y) under the Csorgo- Revesz conditions. This 
rate, in the case of the Hermite rank 1, coincides with the scaling factor 
for the weak convergence of the Bahadur-Kiefer processes in (fI7|) and (fT9]l . 
Since the uniform and the general Bahadur-Kiefer processes have different 
limits, the rate obtained for their nearness in [TI] cannot be improved. 



In this paper we deal with several problems. First, unlike in [15] or 
[26], we consider quantile and Bahadur-Kiefer processes on the whole inter- 
val (0, 1) under very general conditions on the distribution function F. As 
it is well-known, quantile processes can have very erratic behavior on the 
tails. Moreover, it should be pointed out that in the LRD case, even when 
we deal with the associated uniform version of quantile and Bahadur-Kiefer 
processes, we also have to deal with the general quantile function of Xi. We 
solve this problem by considering these processes with appropriate weight 
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functions. With this help, we can conclude various strong approximations, as 
well as some remarkable phenomena not shared with i.i.d. sequences, includ- 
ing weak convergence of the Bahadur-Kiefer processes, or different pointwise 
behavior of the general and uniform Bahadur-Kiefer processes. Further on, 
we deal with the general quantile process qn{y)- Via its weak convergence, 
we obtain confidence intervals for the quantile function Q. Moreover, if one 
considers the subordinated Gaussian sequence Yn = G{Xn), then the behav- 
ior of the quantile process does not only depend on the marginals of l^'s 
and the dependence structure (i.e. the parameter f3), but also on a "hid- 
den" LRD sequence {Xi,i > 1}. This property cannot occur in a weakly 
dependent case. 

Although, especially by dealing with weight functions, the paper is fairly 
technical, however, the choice of 'good' weight functions allow us to obtain 
reasonable simultaneous confidence intervals for the quantile function (see 
Section [22]). 

Our results are presented in Section [2j That section is concluded with 
a number of remarks (see Section 12. 3p , including a discussion of the recent 
paper [TTj . The proofs are given in Section [3] 

In what follows C will denote a generic constant which may be different 
at each of its appearances. Also, for any sequences a„ and 6„, we write 
o-n ~ bn if lim„_>oo a„/6„ = 1. Further, recall that i{n) is a slowly varying 
function, possibly different at each place it appears. Moreover, f^^^ denotes 
the kth. order derivative of /. 



2 Statement of results and discussion 

For discussing our results, we introduce some notation. 
Let p be a positive integer and put 

n p 

1=1 r=l 
n 

i=l 

SO that Sn,iix) = nFn{x) + f{x)Y^^=iXi, and Snfl{^) — f^Fnix)- Setting 
Ui = F{Xi) and x = Q{y) in the definition of Sn,p{')^ arrive at its 
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uniform version, 

n p 

~Sn,M = i:(iw<.}-2/) + E(-ir'^^'^^(Q(y)K: 



i=l r=l 
n 



=■■ T.ihu,<y}-y)-Vn,piy)- (20) 
1=1 

Recall that 

Rn{y) = an{y) - f{Q{y))qn{y), y e (0, i), 

is the Bahadur-Kiefer process and 

Rn{y) = an{y)-Un{y), ye (0,1), 

is the uniform Bahadur-Kiefer process. 

We shall consider the following assumptions on the distribution function 

F. 

(A(p)) The functions (f^"-^^ o Q)^^\y), r = 1, . . . ,p, are uniformly bounded. 
The integer p will be chosen appropriately in the sequel. 

(B) The function (/ o Q)^'^\y) is uniformly bounded. 

(C(p)) Forr = 0,...,p-1, 

sup q^iyil-y^f'^^Oir, 
j/e(o,i) J{Q{y)) 

2.1 Strong approximations 

Let 

a-n = (Tn,in~Moglogn = n'^'^'^) Lo{n) log log n, 

bn = CT^ in-^an(loglogn)^/^ = n-(3^-i)L|](n)(loglogn)3/^ 

cn = (T->„(logn)V2 = n-(2/5-^)L2(n)(loglogn)3/2(logn)l/^ 

_ f n-(i-^)Loi(n)(logn)5/2(loglogn)3/4, (jo + l)(2/3 - 1) > 1 
"'^ ~ I n-P(^-^)Lg(n)(logn)i/2(loglogn)3/4, (p+ 1)(2/? - 1) < 1 ' 

bn,p = Crn,l"~^C^n,p(loglogn)^/^, 

and 

(5„ = n-(2'3-i)L2(n)(loglogn). 
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2.1.1 Reduction principles for the uniform quantile process 

First, we deal with reduction principles for quantiles. Ho and Hsing, [13 p. 
1003] asked, whether there was an expansion for the quantile process which 
mirrors that in their Theorem 2.1 for the empirical process. We have the 
following result. 

Theorem 2.1 Assume (B), and either (A(l)) or (A(2)) according to (3 > 
3/4 or (3 < 3/4. Then, under the conditions of Theorem II. H as n —> oo, we 
have, 



sup 

ye{o,i) 



niy)+a-\fiQiy))J2Xr 



i=l 



Oa.s.(dn,i), if /3>3/4, 
Oa.sXan), if/3<3/4. 



(21) 



If (3 < J, the bound is is optimal. 

To remove assumptions (A) and (B) we shall consider a (possibly) weighted 
approximation of the uniform quantiles. Define ipi{y) in the following way. 
If /3 < |, then Vi(y) = 1 if (C(2)) holds, and Vi(y) = (y(l-y))^"5+^, ^ > 
otherwise. If /? > |, Vi(y) = (y(l - y)V^''- 

Theorem 2.2 Let p = 2. Then, under the conditions of Theorem 11.11 as 

n oo, we have. 



sup Vi(y) 
!/e(o,i) 



i=l 



Oa.s.(dn,i), if /3>3/4, 
Oa.s.ian), if/3<3/4. 



(22) 



If (3 < J, the bound is optimal. 



From Theorems 12.11 or 12.21 and Lemma 13.61 below we have the following 
reduction principle for quantiles, which mirrors that for the empirical pro- 
cess. In order to state the result, redefine ipi to be 1 if, for a given p, (A(p)) 
holds, and be it as before otherwise. The result is stated for /? < |, only in 
order to avoid the additional term coming from (in,i- 

Corollary 2.3 /3 < |. Let p > 1 be an arbitrary integer such that p < 
{2(3 — 1)""*^. Assume that either (A(p)) and (B), or (C(p)) hold. Under the 
conditions of Theorem II. IL as oo. 



sup (T„_pVi(y)|y - Uniy) + n Vn,p{y)\ 
y6(o,i) 



Oa.s. {n-^^l^-P^^Ll'^in) log log n(log n] 



1/2^ 
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2.1.2 Approximations of the uniform Bahadur-Kiefer process 

Similarly to the uniform quantile process, in Theorem 12.41 we obtain strong 
approximation of the uniform Bahadur-Kiefer process on the whole interval 
(0, 1) on assuming (A) and (B). 

Theorem 2.4 Assume (B), and either (A(2)) or (A(3)) according to (3 > 
2/3 or (3 < 2/3. Under the conditions of Theorem 11.11 as n ^ oo, 



sup 

y6(o,i) 



I Oa...K,2), if /3>2/3, 
[ Oa.sXcn), if /3 < 2/3. 

(23) 

To remove assumptions (A) and (B), we shall consider a weighted approx- 
imation of the uniform quantile and Bahadur-Kiefer processes. Define for 
arbitrary ^ > 0, 

if /? < I and (C(3)); 



V'2(y) 



(y(l _ 

(y(l - 

(y(l_y))7+M, 



if /? < |,7 < I and not (C(3)); 
if /3 < I and 7 > |; 
if /? > !• 



Theorem 2.5 Under the conditions of Theorem 11.11 as n ^ oo, 



sup V2(y) 
yG(o,i) 



i?„(2/)-n-V„-l/«(Q(y))K:X, 



^1=1 



Oa.s.«2), if /3>2/3, 
Oa.«.(Cn), if/3<2/3. 



Prom Theorem 12.41 or [231 and Lemma [3. 61 below, we obtain the reduction 
principle for the distance between the uniform empirical and the uniform 
quantile processes, similar to that of Corollarv 12. 3i Further, an immediate 
corollary to Theorem 12.41 via the LIL for partial sums ^27=1 -^i (see (I32p 
below), is the following result. 

Corollary 2.6 Under the conditions of Theorem 12. 4^ if P < |, 

limsupa-in(loglogn)-i sup \Rn{y)\ =' c{l3,l) sup |/(')(Q(y))|, (24) 
' 1/6(0,1) i/e{o,i) 

where c^{(3,p) = {^f^ x-^{l + x)~^dx) {I - l3)-^{^ - 2(3)-^ . 

Corollary 2.7 Under the conditions of Theorem 12. 4|, if (3 < |, 

a-\nRn{y)^f^^\Q{y))Z\ 
The corresponding results can also be stated in the setting of Theorem 12.51 
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2.1.3 Approximation of the general Bahadur-Kiefer process 

As for the general Bahadur-Kiefer process, a typical approach in the i.i.d. 
case is to approximate the normalized quantiles f {Q{y))qn{v) via the uni- 
form quantiles and then use this to generalize all results valid in the uniform 
case to the general one, as described in the Introduction (cf. (fT2]) . p^ ). This 
approach was also followed in [11, Section 4] as well. However, this cannot 
work in the LRD case, for then the uniform and general Bahadur-Kiefer 
processes have different limits (cf. (fT7|) . (fT9|) ). Moreover, assumptions (A) 
and (B) do not help in this case. 
With arbitrary > 0, define 

r (y(l - if /3 < I and (C7(3)); 

Mv) = { - V)?^-^^^ if /3 < i and not (C(3)); 

[ (y(l-y))2+27+M, if /3>|. 

We have the following result. 

Theorem 2.8 Under the conditions of Theorem 11.11 we have with some 
Co > 0, as n ^ oo, 

sup i^siy) 
ye(Co5„,i-Co5n) 

/ Oa.s.K2), if /3>2/3, 
\ Oa.sXcn), if /3<2/3. ■ 

/f 7 = 1 then the above estimate is valid on (0, 1). 

The (weighted) almost sure behavior of i?„(-) and (weighted) convergence 
can be obtained in the same way as that of Rn{-) in Corollaries 12.61 and 12. 7[ 

2.2 Weak behavior of the general quantile process and its 
consequences 

Ho and Hsing's result (fHI) would suggest that it should be possible to ap- 
proximate qn{y) at least on the expanding intevals, {n~^, l — n~^). However, 
as we will explain below, this is not the case. 

Let ip4{y) = 1 or y(l — y) according to /? < | or /? > |, respectively. 

Proposition 2.9 Assume (CsRl)-(CsR4). Then 

sup tlJ4{y)\f{Q{y))qn{y) -Un{y)\ =Oa{an.in~'^£{n)), (26) 
ye(o,i) 

where Oa = Oa.s. i/7 = 1, and Oa = Op if j > 1. 



Rniy) 



n a. 



n.l 



(25) 
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Corollary 2.10 Assume (CsRl)-(CsR4). Then, under the conditions of 
either Theorem 12.11 or I2.2L as n — > cxd, 



sup '>pi{y)f{Q{y)) 
ye{o,i) 



i=l 



Op(n-(^-^)£(n)). 



Corollary 2.11 Assume (CsRl)-(CsR4). Then, under the conditions of 
either Theorem 12.11 or 12.21 as n —> oo, 



sup (y(l - y)Y 

J/S(n~l,l— n~i) 



i=l 



op(l), 



where 



1/ > 7 - (/3 - i), if /3 < I and either (A(2)) or (C(2)); 
1/ > 27 - /?, if /3 < f and neither (A(2)) nor (C(2)); 

^>27-(/3-l), if /3>|. 

From this result one obtains the following simultaneous confidence bounds, 
which cover all the data available for y G (n^^, 1 — n^^), 

Q„(y)-a„,in~^Cj.2;a(y(l - y)y < Q{y) < Qn{y)+crn,in~^CuZa{y{l - y))'" , 

where Za is the (1 — a/2)-quantile of the standard normal law, and 

Cu = sup (y(l - y)y. 
ye(o,i) 

Another consequence of Corollarv l2.10l is that for some kn = A;n(7, /3) — > 
0, as n — > oo. 



sup 

y£{kn,l-kn) 



Qniy)+cr,^^l^Xi 



i=l 



op(l), 



and thus 

Qn{y)l{ye{k,,,i-k„)}^Z. (27) 

Optimally, one would hope to obtain weak convergence on (n~^, 1 — n~^), 
but this is not a good way to treat quantiles in the LRD case at all. To see 
this, recall the subordinated Gaussian model = Take G = F^^^. 

For the uniform sample quantile process Un (y) associated with the sequence 
{Ynyi^ ^ 1} one obtains in the spirit of [11' Proposition 2.2] (see [7] for a 
correct proof) 



sup 

s/e(o,i) 



niy) + a;,\cP{<^-\y))J2Xi 



1=1 



Op{n-^'^-^k{n)). (28) 
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Moreover, from [11^ Proposition 4.2], if the distribution F oi Y = G{X) 
fulfills (CsRl)-(CsR3), then for some k'^ 0, 



sup 



/(Q(y))Qn(y) + cT-Xci>-i(y))^x, 



i=l 



where Qniy) is the general quantile process associated with y„. Thus, 



f{Q{y)) 



(29) 



(30) 



provided ''^/'(Qfa))^"* is uniformly bounded. In particular, if / is exponential, 
then this is not the case. Consequently, we may have two LRD models, 
both with the same covariance structure, both with the same exponential 
marginals, say, so that in case of ([1]) the general quantile process converges, 
while in the subordinated Gaussian case it does not converge (cf. (i27|) and 
(j30]) . respectively). On the other hand, in both cases, the empirical processes 
have normal limits sclaed by a deterministc function. In other words, subor- 
dination can completely change convergence properties of quantile processes, 
even if the empirical processes behave in the same way in the subordinated 
and non-subordinated cases. The weight function (y(l — y)Y solves this 
problem somehow. 



2.2.1 Trimmed means 

In the model ([T]), assume that Xi are symmetric. Prom (I27p one easily 
obtains 



a, 



ra,l 



[n(l-fc„)] 




rl-kn 






/ qn{y)dy 


i=[nkn] 




Jkn 



\z\. 



On the other hand, since EXi = 0, Jq qn{y)dy = cr^\ EiLi^d ~^ \^\- 
kn < In ^ ^ then the result remains true by considering weak convergence 
in ([27|) on (/„, 1 — /„) and then arguing as in the case of A:„. Summarizing, 

Corollary 2.12 Assume (CsRl)-(CsR4) and that Xi are symmetric. Let 
kn ^ In ^ 0- Then, under the conditions of either Theorem 12.11 or \2.2\ 



[n{l-i„)] 
i=[nl„\ 



(31) 
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The result (j3ip states essentially that, whatever trimming we consider, the 
deleted part is negligible. 

However, it should be mentioned that this approach to the trimmed sums 
is not the optimal one. The problem is considered in more details in [19j 
and [2D] via studying integral functionals of the empirical process (see e.g. 
[5] for the description of the method in the i.i.d case). 

2.3 Remarks 

We start with pointing out some phenomena which are exclusive for LRD 
sequences. 

Remark 2.13 As mentioned in the Introduction, it was observed explicitly 
in [llj and can be concluded from [26j that the uniform Bahadur-Kiefer pro- 
cess (in case of [11]) and, under appropriate conditions, the general Bahadur- 
Kiefer process ([26]) converge in D{[yQ,yi]) for a particualt choice of the 
parameter /3. From our results we conclude that both processes converge 
weakly in -D([0, 1]) if /3 < |. This is striking difference compared to the i.i.d. 
case, for in the latter case these processes cannot converge weakly (cf. [IB] . 
|17j). Considering pointwise convergence, in the i.i.d. case the uniform and 
the general Bahadur-Kiefer processes converge to the same limit (cf. [TU] for 
a review). Here, the pointwise limits are different, on account of different 
weak limits. 

Remark 2.14 Unlike in the i.i.d case, to study the distance between the 
uniform empirical and the uniform quantile processes, we need to control the 
general quantile process, which can be done via controlling the quantile and 
density quantile functions associated with Xi. The reason for this is that 
the uniform quantile process contains information regarding the marginal 
behavior of random variables Xi. This is visible from Theorems 12.11 and 
12.21 - the uniform quantile process depends on the density-quantile function 
f{Q{y)) associated with Xi. As can be seen in (j28p . this remains true in the 
subordinated case Yi = G{Xi) as well, namely the uniform quantile process 
contains information about the marginals of Xj, not of Y^. This has a impact 
on the behavior of general quantiles, as described in Section 12.21 

We continue with some technical remarks concerning assumptions and 
results above. 

Remark 2.15 We comment on the different rates in our theorems, accord- 
ing to different choices of (3. 
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If p = 1 then an = o((i„^i), if p = 2 (so that (3 < 3/4), then dn^2 = o(a„), 
and then optimal rates are attained in Theorems 12.11 and 12.21 Taking higher 
order expansions (p > 3) does not improve rates and requires additional 
restrictions on /3 and condtions conditions on F, either (A(p)) or (C(p)). 

Likewise, ii p = 1,2, then = o{dn^p)- If p = 3 (/? < |), then dn,z = 
o{cn)- Then we can identify (but not prove !!) optimal rates in Theorems 
12.41 12.51 We conjecture, that the bound in Theorem 12.41 (at least for /5 < |) 
is valid without the (logn)^/^ term due to the following conjecture. 

Conjecture 1 For any p > 1, 
lim sup cr~ 

n— >oo 

where c{(3,p) is as in Corollarv 12.61 

Further, on comparing Theorem [23] with (I15p we can see that the method 
in [26j leads to better rates for /3 close to 1. We loose some rates for /3 close 
to 1, since then the error in the reduction principle dominates. On the 
other hand, Wu's method is unlikely to work when one wants to deal with 
approximations on the whole interval (0, 1), which was our main goal. In 
fact, in view of a weighted law of the iterated logarithm (see Lemma l3.10p . 
it is not likely that in the case /? > | the estimates on (0, 1) can be obtained 
with optimal rates, unless the rate d^.p is improved. 

Remark 2.16 Wu in his paper [25] has in fact some weaker conditions on 
-Fg, than those stated in Theorem ll.il Also, here, we avoid the boundary case 
(p+l)(2/3— 1) = 1. Furthermore, under stronger regularity conditions on the 
distribution of ei, the reduction principle (with worse rates) for the empirical 
process remains true provided Elep"*'^ < oo, 5 > (see [l3]). Thus, some of 
the results here remain valid under the Giraitis and Surgailis conditions in 
[13) . However, to prove Theorems 12.21 and 12.51 we require Lemma 13.91 below, 
where the rates in the reduction principle fo Theorem ll.il are crucial. 

Remark 2.17 We comment on assumptions (A(p)), (B) and (C(p)) on the 
distribution function F. Note that —{fo Q)^^\y) = J{y) is the so-called 
score function (cf. e.g. [H p. 7]), thus (A(l)) requires uniform boundness 
of the latter. This is not valid if one takes the standard normal distribution 
for example. The assumptions (A(p)), p > 1 are fulfilled if one takes the 
exponential, logistic, or Pareto distribution f{x) = a{x^~^°^)~^ , x > 1, a > 0. 
Assumption (B) is fulfilled if one takes exponential, logistic, or Pareto with 
a > 1. The latter constrain a > 1 is relevant, since in view of Theorem 
11.11 we work under the condition Ee*^ < oo and, consequently, EX'* < oo. 
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Further, {C{p)), p > 1, is fulfilled in the Pareto case and for the standard 
normal case. Thus, essentially, most of the "practical" parametric families 
fulfin either (A(p)) or (C(p)). 

Further, in the LRD case ([1]) it is very unlikely that / has bounded 
support (from either side). Moreover, to use of Theorem ll.il we need Ee = 
and fe = to be smooth. Consequently, the same properties are transferred 
to X and its density /. Therefore, to make use Theorem 1 1 . 1 1 and assumptions 
(A(p)) and (B) simultaneously, we should consider the above comments for 
double exponential or symmetric Pareto, appropriately smoothed around 
the origin. Nevertheless, the main issue of assumptions (A(p)), (B) and 
(C(p)) is the tail behavior. 

Remark 2.18 As for the general quantile and the general Bahadur-Kiefer 
processes, in order to obtain their approximations on the whole interval, 
we assumed the monotonicity property (CsR4). In principe, as in the i.i.d 
case, (cf. [1]), it should be possible to obtain their approximations on the 
"practical" interval (n~^, 1 — n~^) without (CsR4). 

Remark 2.19 We now discuss the weights which appear in our theorems. 
As mentioned in Remark 12. 14^ the LRD sequences based uniform quantile 
process "feels" the general quantile function. In the i.i.d. case one knows 
that for > 

hmsup sup (y(l - y)r\Qiy) - (y)! < oo 

n^oo yG{0,l) 

almost surely if and only if \u\^^''''dF{u) < oo (see [21 p. 98] for a tribute 
to David Mason in this regard). Therefore, our weight functions {y{l — y))'^, 
with some k > 0, appear to be natural to use. 

We also note that instead of the weight {y{l — y))^^'', k > 0, we may 
consider (Qiy)) as a weight function, where k' depends on both k and 7. 

Remark 2.20 In Theorem 12. 8^ in case 7 > 1, the approximation in proba- 
bility remains valid on (0, 1) (see also Proposition 12. 9p . We are not able to 
do this almost surely, since we do not have a precise knowledge about the 
LRD behavior of order statistics (see the proof of Proposition 12. 9p . 

Remark 2.21 The bound in Theorem 12.11 is determined by the behavior 
of the Bahadur-Kiefer process Rn{y) (compare Theorem 12.11 with (|24p '). 
This is somehow similar to the i.i.d. case. One knows that on an ap- 
propriate probability space, supj^g(o,i) |a"'^(y) - Bn{y)\ = Oa.sX"-"^^^ logn). 
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where Bn{-) are appropriate Brownian bridges. Further, via (jlOp we can see 
that with the same Brownian bridges we have sup^^g^o,!) I^n^(y) ~ Bn{y)\ = 
Oa.s.(^"^^^(logn)i/2(loglogn)V4). We may for example refer to [9j and [lOj 
for more details. 

Remark 2.22 Recall, from Section 12.21 our lines the subordinated Gaus- 
sian case Y = G{X). We have Ji(y) = — where 0, $ are the 
standard normal density and distribution function. Csorgo, Szyszkowicz 
and Wang in [11] proved their Proposition 2.2 assuming (cf. also their Re- 
mark 2.1) their Assumption A. However, what is really used in their proof 
is that Ji has, in particular, uniformly bounded first order derivative, which 
is not true, since J{(y) = — Consequently, their Proposition 2.2 and 
all its consequences in their Sections 2.1 and 2.2 are valid only if one restricts 
them to intervals [t/o, or assumes that Y = G{X) has finite support. This 
actually is the reason that we considered assumptions (A(p)), (B) and/or 
weighted approximations. Clearly, the non-subordinated Gaussian case can 
be treated as in the setting of Theorems 12.21 12.51 and 12.81 with 7 = 1 (recall 
that (C(p)) holds in the Gaussian case). For the general treatment we refer 
to [3. 

Also, as noted already in our Section r2.1.31 results for the general Bahadur- 
Kiefer process cannot be concluded from an approximation of the latter by 
the uniform one. Hence, the proposed proofs for Theorems 4.1, 4.2 of [llj 
via the invariance principle of Proposition 4.2 cannot work and, in view of 
[26], the claimed limiting processes can at best be correct if multiplied by 
1/2- 

In Section 3 of [11] the authors consider Vn{t) = 2a^\n Jq Rn{y)dy and 
Qn{t) = ynii) — ctn(^)) ^hc so-called uniform Vervaat and Vervaat Error 
processes. As a consequence of our comments so far on paper [llj, we note 
that the results in this section are valid only if G{X) has finite support. 
An extension is possible if one has assumptions like (A(p)) and (B). This, 
however, is out of the scope of this paper. 
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3 Proofs 



3.1 Preliminary results 

We recall the following law of the iterated logarithm for partial sums X^iLi 
(see, e.g., [24j): 



lim sup cj„ \ (log log n) 



"1/2 



i=l 



c(/3, 1) 



(32) 



where c(/3, 1) is defined in Corollary 12.61 



Lemma 3.1 Let p > 1 be an arbitrary integer such that p < (2/3 — 1) ^. 
Then, as n ^ oo, 



Yn,p = Oa.s.(o-n,p(logn)^/^ log log 



n 



(33) 



Proof. Let = (T^_plogn(loglogn)^. By ([2]), [261 Lemma 4] and Kara- 
mata's Theorem we have 



n,p\ 



2d 



(l_p(2/3_l))/2^p^2i) 



— 22'^-*(2/3-i)L^P(2'^) ~ d-\\ogdy 



Therefore, the result follows by the Borel-Cantelli lemma. 



As an easy consequence of (f32]l and (1331) we obtain the next result. 







Lemma 3.2 Let p > 1 be an arbitrary integer such that p < (2/3 — 1) ^. 
We have 



limsupcr„{(loglogn) sup |y„,p(y)| =' c(/3, 1). 



2/G(0,l) 



(34) 



Using Theorem 11.11 and the same argument as in the proof of Lemma 
13.11 we obtain 

a-^p sup \Sn,p{x)\ 



Oa.s.(n-(5-P(/5-i))^-P(„)(log^)5/2(iQgiQg^)3/4)^ (p+l)(2/3_ 1) > 1 

Oa.s.(n-(^-^)Lo(n)(logn)i/2(ioglogn)3/4), (p+ l)(2/3 - 1) < 1 
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Since (see ([2])) 



(35) 



we obtain 

sup \Pn{x) + (T~}iVn,p 



0". 



sup 



Consequently, via {a„(y),y G (0,1)} = {f3niQiy)),y G (0,1)}, 

sup |a„(y) + CT^}K.p(y)| = Oa.s.('^n,p)- 
2/6(0,1) 



(36) 



Remark 3.3 For convenient reference, we collect here various relations be- 
tween constants. Recall that dn,2 = o{an) provided /3 < |, and dn,3 = o(c„), 
provided /3 < |. Further, CT~\bn,p = o{dn,p)- It is not necessarily true that 
a~\ = o{dn,p), but it is always true that a~\ = 0(0^). 

3.2 Proof of Theorems [HI] and [271 

First, we bound the distance between the uniform empirical and uniform 
quantile processes. 

Lemma 3.4 Let p > 1 be an arbitrary integer such that p < {2(3 — 1)""^. 
Assume (A(p)). Under the conditions of Theorem 1 1 . 1 1 we have, as n ^ 00, 

sup \Un{y) - an{y)\ = Oa.s.(an) + Oa.,sXdn,p)- 
S/6(0,l) 

Proof. Note that 

un{y) = a~ln{En{Un{y))-Un{y))-cj;^ln{En{Un{y))-y) (37) 
= a-\n{En{Un{y)) - Un{y)) + Oa.s.«,l) = an{Un{y)) + 0(^-1). 

Thus, by (l36l) . 

sup |n„(7/) - a„(y)| (38) 
ye(o,i) 

= sup \an{Un{y)) - an{y)\ + Oa.s.(cr^l) 

ye{o,i) 

< (T;^i sup \Vn,p{y) -Vn,p{Un{y))\+0^,s.{a:^\) +0^,s.{dn,p). 

j/e(o,i) 
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Accordingly, in view of Assumptions (A(p)), (B), we have to control 



sup \f{Q{y))-f{Q{Un{ym 

?/6(0,l) 

and 



i=l 



< C sup \y-Un{y)\ 

2/6(0,1) 



1=1 



(39) 



sup E - f^'-'\QiUn{y))) 

?/e{o,i) 

p 



n,r I 



(40) 



< C sup \y - Un{y)\ 
ye(o,i) 

From (1341) and (1361) one obtains 



r=2 



limsup(loglogn)"'^/^ sup |a„(y)| '^=' c(/3, 1). 

n^oo J/e(0,l) 

Consequently, as n ^ oo, 

sup \y-Un{y)\ = sup (Jn,in''^\un{y)\ = sup | Q„ (y) | 

ye(0,l) yG(0,l) yG(0,l) 

= 0a.s.(^n,in-l(l0gl0gn)l/2) =Oa.s.(an)- (41) 

Therefore, on combining ([32]) . ([39j) . (jH]), as n — > oo, one obtains 



E^^ 



Having (j33|) . (j40l) and (142]) . as n — > oo, we conclude 



sup <il/(Q(2/))-/(g(f/n(y)))| 

s/e(o,i) 



sup cr„l|K,p(2/) - K,p(C/'n(2/))| = Oa.s.(an)- 

1/6(0,1) 

Thus, by ([38l) and (H3]) . as n — > oo, 

sup |u„(y) - an(y)| = Oa.s.(an) + O(CT^I) + Oa.sXc^n.p) 

y6(o,i) 

and hence the result follows. 



(42) 



(43) 







If /3 > 3/4, take p = 1 and assume (A(l)). li (3 < 3/4, take p = 2 and 
assume (A (2)). As a consequence of Lemma [331 (p3]) . ([36]) and Remark [37 
we obtain (f2T]) . 
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3.2.1 Proof of Theorem [2741 



In Lemma [3.41 we have a bound on the distance between the uniform empir- 
ical and the uniform quantile processes, but it does not say anything about 
its optimaUty. To obtain this note, that for any 1 < p < (2/3 — we have 
by (IM|) and as in ([38]) 



sup |a„(y) - Un{y) + i(K,p(y) - K,p(f^n(y)))| 
j/e(o,i) 

< sup \an{y) - an{Un{y)) + (J-\{Vn,p{y) - Vn,p{Un{y)))\ (44) 

y6(o,i) 

+ sup |a„(C/„(y)) - Un{y)\ = Oa..s.{dn,p) + Oa.s.(o"n l)- 

ye{o,i) 

Now, it is sufficient to deal with the process (I4i,p(y) — Ki,p(CAi(y)))- We 
approximate this process via several lemmas. 

Lemma 3.5 Let p > 1 be an arbitrary integer such that p < (2/3 — 1)""^. 
Assume (A(p)) and (B). Under the conditions of Theorem 11.11 we have as 
n — > oo, 



sup 

yG{o,i) 



fiQW) n ^ 



C'a.s.(&n)+Oa.s.(&n,p)- 



Proof. Applying second order Taylor expansion and recalling that (/ 



Q)(^Hy) = ^jgg^, one obtains 



sup 

?/e{o,i) 



{f{Q{y)) - f{Q{Un{ym E + n'' ^-^^^^^Vn,p{y) J2 X, 



< sup 

2/6(0,1) 



f^'\Q{y)) 



f{Q{y)) 

f{Q{y)) '^'^'^'^'^ ^ (""^^^ ^ ^n,l^n,p(y) 

n 



i=l 



i=l 



+ sup |(/oQ)(2)(y)| sup {y-Un{y)f 

y6(o,i) ye(o,i) 

= Oa.s.(o-n,ira""^anO"n,l(loglogn)^/2) + Oa.s. (crn,ira~^(i„,pCT„,l (log log n 
+Oa.s.(fT',in-2(loglogn)3/2) = Oa.s.(6n) + Oa.s.(6n,p). 

The above bound follows from dMD, ([MI), (jH]) and dH]) Theorem EH 
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Lemma 3.6 Let p > 1 be an arbitrary integer such that p < (2/3 — 
Assume (A(p)) and (B). Under the conditions of Theorem 11.11 we have as 
n — > oo, 



^ f(n( w \^n,p{y) -Vn,i{y)\ 



Oa.s.(fen(logn)l/2). 



Proof. We have 
sup n"^ Vn^piv) - Vn,i{y)\ 

2/6(0,1) I 



< sup |/«(Q(y))|n-i|y„,2| 

3/6(0,1) 



E^^ 

1=1 



+ Oa.s. n 1 



p 

r=3 



E^^ 

i=l 



Using ([32]) . ([33]) . we obtain the result. 







Similarly to Lemma 13.61 the next result holds true as well. 



Lemma 3.7 Let p > 1 be an arbitrary integer such that p < (2/3 — 1)""^. 
Assume (A(p)) and (B). Under the conditions of Theorem 11.11 we have as 
n — > oo, 

sup |K,l(y) - Vn,liUn{y)) - (VnAy) " K,p(f/n(?/)))| = O^.s. (6n (log n) ^2) . 
2/6(0,1) 

From Lemmas 13. 5|, 13. 6^ 13.71 we obtain 

Corollary 3.8 Let p> 1 be an arbitrary integer such that p < (2/3 — 1)""^. 
Assume (A(p)) and (B). Under the conditions of Theorem 11.11 we have as 
n oo, 



sup 

2/6(0,1) 



= 0^,s.{b„{logn)^/'^) +Oas{bn,p)- 

Recall that Rn{y) = an{y) - Un{y)- Then, by 



sup \Rniy) + <7„ i(K,p(y) - K.p(C^n(y)))| = Os..s.{dn,p) + Oa.s.(o-„ 1 
2/6(0,1) 
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Consequently, via Corollary 



sup 

S/6(0,l) 



= 0^.sXdn,p) + 0^.s.{(7n}lbn{\ogn)^/'^) + 0^.s.{(7-\bn,p) + Oa.s.(<l) 
= Oa.s.(t^n,p) + Oa.s.(Cn.) + Oa.s.(Vl)- 

If /3 > 2/3, then the bound is 0^,s.{dn,2) on assuming (A(2)). If /3 < 2/3 
taking p = 3, via Remark 13.3^ we obtain the statement (|22p of Theorem [2 



3.3 Proof of the optimality in Theorem 12.11 

If /3 < |, then the dominating term in Theorem 12.11 is Oa.s.(^n; 







Fix y = Uo- Via (j36j) and as in we obtain 



lim sup cr„ in(log log n) ^ u„(yo) + i/(yo) ^« 

1=1 

= limsupn(c7„,i loglogn)"Vn(yo) - an(yo) + (an(yo) + o-^lK,p(yo))| 

n— >oo ' 

= c(/3,l)|/«(Q(yo))|. 
Therefore, via ([2T|) . for any yo G (0, 1), 



c(/?,l)|/«(Q(yo))| <limsup- 



n 



sup 



n^oo cr„,iloglogn j^g(o_i) 
which means that the bound is optimal. 



Uniy) + 



Oa.s.(l) 







3.4 Proof of Theorems [M] and [2751 

3.4.1 Properties of the density-quantile function 

Note that under an appropriate smoothness of /, (CsR3) is equivalent to 
(CsR3(i)) f{Q{y)) - y^'^Liiy-^), as y j 0, 
(CsR3(ii)) /(Q(l - y)) ~ (1 - y)^2L2((l - y)"^), as y T 1, 
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for some numbers 71, 72 > and some slowly varying functions Li, L2. The 
parameter 7 in (CsR3) and 71,72 are related as 7 = 71 A 72 (see [E]). Let 
7o = 7i V 72- Under (CsR3(i)) and (CsR3(ii)) we have for any fi > 0, 

(v(l - ?/))'^+^ 
sup ^ \, J\\ =0(1)- (45) 

Further, note that if < 71 < 1 (0 < 72 < 1) then F has bounded support 
from the left (from the right) (see [21j). Thus, we assume without loss of 
generality that both 71 and 72 are not smaller than 1. In this case, for any 
e > 0, 

f{Q{y)) = 0{y'-'), y^O. (46) 

Note also, that (CsR3(i)) and (CsR3(ii)) together with 70 > 1 imply that 
for any ^ > 0, 

sup L^^i^^(y(l-y))/^ = 0(l). (47) 

Further, by [211 P- 116], 

as y ^ 0. The parameter k is positive if 71 > 1 or k = if 71 = 1. A similar 
consideration applies to the upper tail. 

3.4.2 Weighted law of the iterated logarithm 

From ([32]), ([Ml), & and Sn^^^dn,p = 0(1) if p > 2 (i.e. /3 < f ) one obtains 

Lemma 3.9 Let /3 < |. Under the conditions of Theorem 11.11 as n ^ 00, 

l«n(y)l r^ 1 ^l/2^ 

771 7T72 = Oa.s.((loglogn) ' ). 

ye{5n,i-<5„) (y(i -y)) / 

Using now the same argument as in [8,, Theorem 2], we obtain a correspond- 
ing result for the linear LRD based uniform quantile process. 

Lemma 3.10 Let /? < |. Under the conditions 0/ Theorem 11.1 L with some 
Co > 0, as n ^ 00, 

\Uniy)\ ^ ,f, , sl/2x 

77i 717^ = Oa.s.((loglogn) ' ). 

ye(Co5„,i-co5„) (y(i - y)r'^ 
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From Lemma |3.10^ by the same argument as in |8j Theorem 3], as n ^ 

oo, 

sup |n„(y)| = Oa.s.(an), (49) 

y6(o,5„) 

provided /? < |. Further, via ([32|) . ([36]) and (jl6]) . as n ^ oo, we obtain for 
arbitrary /? G (1/2, 1) and 1 < p < (2/3 - 1)"^ 

sup |a„(y)| = Oa.s.('^n"^(loglogn)^/^)+Oa.s.(c^n,p) = Oa.s. (an)+Oa.s. (^^n.p) • 

ye{0,5„) 

Recah Let 6 = 9n{v) be such that \9 — y\ < (yn,in~^\un{y)\ = 

Oa.s. (n-(^~ 2)Lo(n)(log log n)V2). Ar guing as in [HI Theorem 3], uniformly 
for y £ (Co(5„, 1 - Co(5„), as n ^ oo, 

(50, 

3.4.3 Proof of Theorem [272] 

First, we need estimates which will replace a part of the proof of Lemma 
I3.4[ All random variables 9 below are as in ()50p . 

Lemma 3.11 Let p > 1 be an arbitrary integer such that p < {2(3 — 
and assume that (C(p)) is fulfilled. Under the conditions of Theorem 12. 2|, 
for any r = 0, . . . ,p — 1, as n ^ oo, 

sup My)\f'HQ{y))-f'^''KQ{Un{ym = Oa.s.(^"^''~^^^o(ri)(iogiogn)i/2). 

ye{Co5n,l-Co5n) 

Proof. Let /? < |. Take first ipi{y) = (y(l — y))'^ 2+^. Taking a first order 
Taylor expansion and bearing in mind that /('"+^) are uniformly bounded, 
we have 

Further, under the condition (C(p)), 

\f^'\Q{y)) - f^'^KQiUniym 

&^'\Q{e)) n^.i/2( y{^-y) V'^ \y-Un{y)\ 

f{Q{9)) ^ ^ " \9{l-0)J (y(l-y))V2- 
Thus, the result follows by Lemma 13.10] ()45|) and (I50p . 
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If /? > |, assume (C(l)). We use the appropriate form of ipi, (|15|) and 





From Lemma [3. m and exactly as in the proof of Lemma \'6A\ as n ^ oo, 

sup 7pi{y)\u„{y) - an{y)\ = Oa.s.(«n) + 0^,s.{dn,p). 

Consequently, by (j49p and the comment below it, as n — > oo, we have for 
/3 < f andp < (2/3- 

sup V'l(2/)|Wn(y) - an(y)| = Os,.s.{an) + Oa.s.idn,p). 

ye(o,i) 

The same estimates are valid for /? > |, since in this case ipi{y) = 0{y). 
Consequently, ([22|) follows. 





3.4.4 Proof of Theorem [231 

First, we show that Lemma 13.51 remains valid when multiplying by V'2(y)- 

From ()47p . Theorem 12.21 and estimating as in Lemma [3. 5 ^ as n ^ oo, we 
conclude 



sup (y(l - y))'4>i{y) 
yG(o,i) 



1 1 



fiQiy)) ,=1 

= Oa.s.(&n) + Oa.s.(c„). 



(51) 



In view of (08]), for the term in Lemma [3.5l involving {foQ)^'^^ (y), we estimate 

n 



(.(i-.)r«r(.-^n(.))^ 



Oa.s.(^n)i 



/(Q(0)) /y(l-y)V+^(y-[/„(y)) 



(0(1-0))!-'^ V^(l-^) 



y(i - y) 



(52) 



uniformly for y G (Co(5„, 1 — Co^n), on account of (CsR3), (06]), ([50]) . Lemma 
13.101 and (j32p . A similar argument yields the same bound for the right tail. 



26 



Further, as n — > oo, 



sup (2/(1 - y)f+^\Vn,i{y) - Vn,i{Un{y))\ 



(53) 



< CoC^ sup f{Q{y))\Y.X,\=0,.,i5l+^an,i{\og\ognf'^) = o^.,Xbn). 
?/e(o,i) 



and by (gTD 



sup {y{l-y)Y+^^ 
ye{o,Co5n) 



51+^/2 sup (y(l-y))^/2 

|/e(0,Co5n) 



/('HQ(y)) 



/(Q(y)) 

Oa.s.(C/'<,n-lloglogn) = Oa.s.(&n) 



Oa 



(54) 



The same argument applies to the interval (1 — Co(^n, 1). Consequently, by 
(fSTT) . (152]) . (1531) . (151) and comparing {y{l-y)Y+^' with (y(l - y))''V'i(y), the 
statement of Lemma [3.51 remains true when multiplying by ip2{y)- The same 
holds true for Lemmas 13.61 13.71 and Corollary 13.81 Consequently, Theorem 
is proven. 



The optimality of the bound in Theorem 12.21 follows from Theorem [27 
in the same way we proved optimality in Theorem 12. 1[ 







3.5 Proof of Theorem [2781 

Let /? < |. Applying a third order Taylor expansion to f{Q{y))qn{y): one 
has 

\un{y) - f{Q{y))qn{y) + o-«,i?^~^ ^^2(Q(^jj ^"(^)l 



' ^ ^ "'^ (y(l_y))3/2- 



We have 

^(3). ^ ^ _ 3(/W(Q(2/)))- 

^ /^(Q(y)) nQ{y)) 
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By the same argument as the one leading to ([52]) . it suffices to control the 
second term. We have 

f{Q{y)) ff^'\Qm^^^_Q^V fy{i-yr' 



f{Q{e)) \ piQie)) ^ 7 \eii-e) 

Under (CsR3(i)), (CsR3(ii)), in view of [HI Lemma 1] one has 

f{Q{y)) < 1 ^ l-(j/Ag) |^ _ ^^^^ 



f{Qm - [yAd l-{yve) 
From this, (|4ip . (j50p and Lemma 13.10] as n ^ oo, one concludes 

i ^^ \^l/2| I \ firM \\ t \ , ^n,i f{Q{y))f^HQ{y)) 2( M 
sup (y(l - y)) I \un{y) - f{Q{y))qn{y) + — ^f3fn/ w ^nivn 

= Oa.s.(^^,in-2(loglogn)3/2). (56) 
Next, taking Taylor expansion for (Fn,i(y) — V^n,i(t^n(y)))) one obtains 

<j(K,i(y)-K,i(f/n(y))) = 

= ^^4^7^(2/ - Un{y)) E X. + CT-K/ o g)(2)(0)(y - Un{y)f E X,. 

/(Q(2/)) ^ 

Like in ([52]) . as n ^ oo. 



sup (y(l - y))'^a-l(/ o Q)^^\e){y - UM) 

?/e(Co<5„,l-Co<5„) 



n 



= Oa.s.(cT2in-2(loglogn)3/2). 

If /? > |, (j56]) and (f57l) remain valid if one replaces the weight functions 
with (y(l -y))2. 
Thus, 



sup V3(y) 
ye(Co5n,l-Co<5„) 



«n(y) - /(Q(y))gn(2/) - (j^X, 



\i=l 



< left hand side of (156 



+ sup My)\Rn{y) + " ^n,l(f^n(2/)))| 

y€(CoSn,l-CoSn) 



28 



+ sup il'siy) a-n\{Vn,i{y) - Vn,i{Un{y))) 



-1 -i/«(Q(y)) 



+fT„,in ^ sup V3(y) 
S/e(Co(5„,l-Co(5n) 

+Oa.s.(<i™"'(loglogn)V2) 



«n(y) + a~lE?=i^, 



fiQiy)) 



by (IMI), dSZl) and dMD together with Lemmas EZl ESI Moreover, by (CsR3) 
and via Theorem 12.21 the bound is of the order Oa.s.(cn) + Oa.s.('^n,p)) as 

71 ^ OO. 



Further, as n ^ (X), 

sup i;3{y)a-\n-^ (j2Xi] = Oa.s.(<^n^''f^n,in"^(loglogn)) = Oa.s.(Cn), 
?;e(0,Co<5„) Vi=l / 

and supj,g(o,Co5„) V'3(y)|an(y)| = 0^,s.{cn). 

Next, having tail monotonicity assumption (CsR4) we may proceed as 
in [8]. Let (k — l)/n < y < k/n. If Uk-n ^ 2/) then 

sup My)\fiQ{y))Qn{y)\< sup V3(y)l^^n(y)| = Oa.s.(<5i'+'^^) = Oa...(Cn). 

yG{0,a)<5„) ye(0,CoS„) 
Further, if Uk-n ^ y, then 

sup V'3(y)l/(Q(2/))gn(2/)| < Ca„}n sup y{y{l-y))'+^' log{6n/Uk:n) 
y€(0,CoS„) y&{0,Co5„) 

for 7i = 1. Now, 

n 

P{Ui,n < n"2(logn)"3/2) < < n~^(logn)"^/2) < n'i(log n)"^/^ 



4 = 1 



(58) 



Consequently, via the Borel-Cantelli Lemma, as n — > oo, C/^.^ = Oa.s.('^^(log^)^'^^)- 
Therefore, 

sup V'3(y)|/(Q(?/))gn(y)| =Oa.s.(Cn) (59) 



y£{0,Co5n) 



follows for 7i = 1. 
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3.6 Proof of Proposition 12.91 

We follow lines of the proof from [SJ Theorem 3] . In view of Lemma 13.101 
and the Taylor expansion of f{Qiy))qn{y), the approximation is valid on 
{Codn, 1 - Co6n), provided /3 < |. For /? > | it remains true by the choice 
of Tpiiy)- 

Having tail monotonicity assumption (CsR4), let {k — l)/n < y < k/n. 
If Uk:n > y, then (cf. (3.13) in [8]) 

sup 'ipi{y)\f{Q{y))qn{y)\< sup V'4(y)|wn(y)| = C>a.s.(a„) 

ye{o,Co5n) i/e(0,Co<5„) 

from dM]) if /3 < |, and by the choice of tp4{y) if /? > |. 
If Uk:n < y and /? G 1), then for 7 = 1, as n ^ 00, 

sup \f{Q{y))qn{y)\ = Oi,,s.{an,in~'^£{n)) 
yG(0,Co<5„) 

by ([58l) . Moreover, as in (f58l) . [/^.^ = op(n(log n)'^/^), as n ^ 00. Therefore, 
for 7 > 1, as n — > 00, 

sup \fiQ{y))qniy)\ = Op{an,in'^£{n)). 
y&(o,CoSn) 
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